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ABSTRACT 

In the context of high dynamic range imaging, this study presents a break- 
through for the understanding of Apodized Pupil Lyot Coronagraphs, making 
them available for arbitrary aperture shapes. These new solutions find immedi- 
ate application in current, ground-based coronagraphic studies (Gemini, VLT) 
and in existing instruments (AEOS Lyot Project). They also offer the possib- 
lity of a search for an on-axis design for TPF. The unobstructed aperture case 
has already been solved by Aime et al. (2002) and Soummer et al. (2003). 
Analytical solutions with identical properties exist in the general case and, in 
particular, for centrally obscured apertures. Chromatic effects can be mitigated 
with a numerical optimization. The combination of analytical and numerical so- 
lutions enables the study of the complete parameter space (central obstruction, 
apodization throughput, mask size, bandwidth, and Lyot stop size). 

Subject headings: techniques: high angular resolution, instrumentation: adaptive 
optics 



1. Introduction 

High dynamic range imaging is a very exciting and promising new field of astronomy and 
astrobiology. Its principal goal is the detection and characterization of exoplanets. It also en- 
ables the study of faint sub-stellar companions, and circumstellar debris and protoplanetary 
disks, e.g. AHCI Conference (2003, 2004). 
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The detection of faint sources around stars is limited by several sources of noise, mainly 
due to the diffracted starlight. This light has to be removed using coronagraphic or nulling 
instruments. In reality, such instruments are sensitive to wavefront errors and temporal 
instabilities, but their performance can be predicted from the results in the perfect case using 
knowledge of the wavefront errors. This can be approached with expansions or statistical 
methods (Sivaramakrishnan et al. 2002; Perrin et al. 2003; Aime & Soummer 2004c). 

The starlight leakage through a coronagraph consists of residual speckles (Sivaramakr- 
ishnan et al. 2001), and techniques for their reduction and calibration needs to be developed 
(Sparks & Ford 2002; Marois et al. 2004; Guyon 2004). If the system is limited by wave- 
front errors, which is the case on most existing systems (Boccaletti et al. 2004), it is not 
worth working to improve their static extinction (Aime & Soummer 2004c). With additional 
speckle reduction techniques, this limit might be pushed back. 

The most exciting current project, the Terrestrial Planet Finder (TPF) requires a mag- 
nitude difference of the order of Am = 25 at 0.1" in the visible, which is far beyond what 
is currently achievable. While early lab demonstrators are necessary along this path, actual 
precursor science must also pave the way with meaningful science results (TPF-SGW 2004). 
Unless a TPF-precursor is funded, for example through a NASA Discovery class mission, 
most of the coronagraphic precursor science will be done on the ground by the next gen- 
erations of Extreme Adaptive Optics (ExAO) coronagraphs followed by Extremely Large 
Telescopes. Several ground-based observatories are currently conducting preliminary studies 
for such instruments (ESO/VLT-PF, Gemini, Subaru, Palomar). 

The near-IR Lyot Project coronagraph on AEOS (Oppenheimer et al. 2004) uses the 
highest order AO system currently available to the civilian astronomical community. It 
operates in the regime where improved coronagraphs start to produce greater science returns. 
It is clear that the next generation of ExAO coronagraphs under study will need a new 
generation of coronagraph designs. 

Ground-based coronagraphs have to deal with centrally obscured telescope geometries, 
at least for the current generation of instruments. It is therefore essential to develop some 
theoretical insight and understanding on how a coronagraph can work under such constraints. 
This is also relevant to TPF, where an off-axis design — the only existing design that meets 
TPF goals — has an extremely tight tolerancing budget. If a coronagraph were able to work 
at the required contrast level with a central obstruction, the error budget and complexity 
of the TPF design could be relaxed. Spin-offs of such a design, such as the possibility of 
additional wide field instrumentation, could also make TPF more interesting to the general 
astronomical community. 
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The need to apodize unobstructed apertures has been demonstrated for Roddier phase 
mask (Roddier & Roddier 1997) and Lyot coronagraphy. 

and particular solutions have been found (Aime et al. 2001, 2002; Soummer et al. 2003b). 
However, even without wavefront errors, these apodizations (Aime et al. 2001, 2002; Soum- 
mer et al. 2003b) cannot be applied directly to centrally obscured apertures and in wide 
bandpasses without considerable loss of efficiency (Soummer et al. 2003a). This effect has 
been also shown by Abe (2003, Private communication), using empirical apodizations to im- 
prove performance. This letter generalizes unobstructed pupil results to arbitrary aperture 
shapes; it presents a breakthrough in our current understanding of Lyot coronagraphy, and 
offers hope for further improvements. Apodized Pupil Lyot Coronagraphs (APLC) present 
the advantage of simplicity and lower sensitivity to errors compared to other techniques 
insensitive to central obstruction (Soummer et al. 2003c; Gay & Rabbia 1996). 

2. General problem of coronagraphy with arbitrary aperture shapes 

Following the notation of Aime et al. (2002) and Soummer et al. (2003b), we briefly 
recall the general formalism of coronagraphy with apodized pupils. The telescope aperture 
function with the position vector r is denoted by -P(r), and $(r) is the apodizer transmission 
(1 without apodization). At the entrance aperture, the wavefront amplitude is: 



A mask of transmission 1 — eM(r) is placed in the focal plane. M is a function that describes 
the mask shape, equal to 1 inside the coronagraphic mask and outside (e = 1 for Lyot and 
e = 2 for Roddier). 

At the Lyot stop plane, the wavefront is then: 



where^is the Fourier Transform. This general relation is valid for any arbitrary aperture 
shape (rectangular, circular or elliptical, with or without central obstruction and secondary 
mirror supports), and any mask shape. 

The formal problem is to find the mask M(r) and the apodizer <3>(r) that provide the best 
cancellation possible inside the Lyot stop, identical to the entrance pupil in this case. The 
above partition of the wavefront (Eq.2) gives a physical understanding of coronagraphy as a 
destructive interference between the pupil wave ^(r) and the wave diffracted by the mask 



# A (r) = P(r)$(r). 



(1) 
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(the convolution integral). A heuristic illustration is given in Fig.l, for a circular geometry. 
In the unapodized case (left), the two wavefronts do not match each other and the subtraction 
leaves a large residual field. The APLC solution is to smooth out the pupil transmission so 
that the wave diffracted by the mask matches the pupil wave. The improvement of the wave 
subtraction is obvious in the Fig.l (right). An opposite approach is to use a clear aperture, 
and instead modify the shape of the wave diffracted by the mask to be a flat function in a 
reduced part of the aperture (Kuchner & Traub 2002). 

A perfect solution (total extinction) is obtained if the wave diffracted by the mask is 
equal to the initial pupil amplitude. In more mathematical terms, this means that 3>(r) must 
be the eigenfunction of the convolution integral in Eq.2. This problem is equivalent to the 
generalization of the uncertainty principle (Papoulis 1968), with the search of band-limited 
functions having the maximum encircled energy within a given spatial domain. In corona- 
graphic terms, the solution is the pupil apodization which produces the most concentrated 
star light behind a given focal plane mask (and thus blocked). This formal problem has been 
solved analytically for rectangular and circular unobstructed apertures (Aime et al. 2001, 
2002; Soummer et al. 2003b) involving linear and circular prolate functions (Slepian & Pollak 
1961; Frieden 1971; Papoulis 1981). In the general case, formal solutions exist (Slepian 1964, 
1965; Papoulis 1968) and are the eigenfunction of the 2-D integral equation: 



The solution $(r) corresponds to the largest eigenvalue A , and to the maximum encircled 
energy behind the focal plane mask e = A . The expression of the residual wavefront inside 
the Lyot stop for circular and rectangular geometries is the same for the general case: 



(the + signifies this is just after the Lyot stop). As detailed in previous work, the wavefront 
is therefore simply proportional to the initial apodization function, with a constant of pro- 
portionality (1 — eA ). This creates the possibility for multiple stage coronagraphs (Aime 
et al. 2002; Aime & Soummer 2004b), which could help TPF reach its required extinction. 

A numerical algorithm, proposed by Guyon & Roddier (2000) for the phase mask, can be 
used to generate the prolate apodizations for the APLC (Soummer et al. 2003a). Starting 
with an initial guess for the apodizer, the principle is to subtract the residual Lyot stop 
wave amplitude from the aperture wave amplitude in an iterative loop. Guyon & Roddier 
(2002) used this algorithm to show that the Roddier phase mask can be used with arbitrary 
apertures. This algorithm works for both the Lyot as well as the general case. A formal 
proof of its convergence in the general case, using mathematical properties of the generalized 
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prolate functions, along with more detail on the properties of the solutions for coronagraphy, 
will be given in a future work. 

3. Specific solutions for circular apertures with central obstructions 

For circular aperture telescopes, Eq.2 can be simplified using the properties of Hankel 
Transforms, and using a kernel K (£,r) which is a function of the focal plane mask size 
(Frieden 1971; Soummer et al. 2003b). The equation can be generalized to: 

tt c (r) = V A (r) - e (2 vr) 2 f K (£, r) d£, (5) 

Jd 2 /2 

where D\ is the primary aperture and Di is the secondary aperture. Solutions exist as a 
subset of the general problem and involve a set of new functions -annular prolate functions- 
with identical properties to circular prolate functions. 

As illustrated in Fig.l, apodizers can have different shapes depending on the size of the 
central obstruction, with important consequences for relative throughput and performance. 
A small obstruction produces an asymmetrical apodizer shape; the larger obstruction has a 
more symmetrical apodizer. This effect depends both on mask size and central obstruction: 
the term M in the convolution of Eq.2 extends over a size of the order of Di/a where a is 
the mask size in units of Xf/Di. It is therefore relevant to compare D 1 /a and D 2 . 

If the extent of M is much larger than the central obstruction (small mask and/or small 
obstruction), the convolution product smooths out the central obstruction, and the result is 
an apodizer with maximum transmission at or near the central obstruction (Fig.l, center). 
The resultant apodizer is very similar to that of the 'classical' unobstructed case. 

If the extent of M is smaller than the central obstruction (large mask and/or large 
obstruction), the convolution simply smooths the inner and outer part of the pupil. The 
result is a symmetrical, "bagel" -shaped apodizer. This regime provides a very high rela- 
tive throughput and is favorable in terms of the residual light distribution, itself apodized. 
Throughputs are illustrated in Fig. 2 for a large range of central obstructions, and for mask 
sizes between 3.5X/D and A.5X/D. The throughput curves present a shoulder correspond- 
ing to the transition from the classical shape to the 'bagel' shape (Fig. 3). There is also 
a gain in angular resolution in this regime due to the lighter apodization, especially near 
the outer-edges of the pupil. Empirical apodizations with similar shapes were proposed and 
manufactured by Jacquinot & Roizen-Dossier (1964). 

Generalized prolate solutions are monochromatic. However, APLCs are sensitive to the 
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PSF size chromaticity (Soummer et al. 2003a). Changing wavelength is formally equivalent 
to changing mask sizes. Since the coronagraphic rejection is not symmetrical around the op- 
timum value, there is a substantial gain in re-optimizing the mask size for broad bandpasses, 
with respect to the maximum encircled energy within the mask. 

Static coronagraphic PSFs are given in Fig. 4, for a 20% bandwidth and several telescope 
shapes. Table 1 gives the mask sizes values optimized for the bandpass. 

4. Conclusion 

This letter presents a breakthrough in the understanding of APLCs, proving the pos- 
sibility of their use with arbitrary apertures, and sketching a method for their broadband 
optimization. This formalism enables the study of the entire parameter space (central ob- 
struction, mask size, bandwidth, Lyot stop size). It is also possible to generate solutions 
taking into account secondary mirror support structures, increasing the complexity with 
azimuthal features in the apodizer. 

This general formalism enables the study of apodized Shaped Pupils (Kasdin et al. 2003) 
hybrid designs, as well as multiple stage coronagraphy (Aime et al. 2001; Aime & Soummer 
2004b). 

The static coronagraphic PSFs given here do not correspond directly to the dynamic 
range; a combination between the generalized prolate and the statistical approach of Aime 
& Soummer (2004c) will be presented in a separate paper. 
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Technology. The author would like to thank C. Aime, A. Sivaramakrishnan and R. Makidon 
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Fig. 1. — Transverse cuts of the two wavefronts that subtract one another in the Lyot 
stop Plane (Eq.2): the pupil wave (solid line) and the wave diffracted by the mask (dashed 
line), for a clear circular aperture (top), then for small and large obstructions. In the non- 
apodized case (left), the two waves clearly don't match each other and the subtraction is not 
efficient. With apodized apertures (right), the match is much better and the two curves are 
proportional inside the aperture (Generalized prolate solutions). The mask sizes have been 
chosen for better visualization. 
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Fig. 2. — Throughput of the apodizer solution to the eigenvalue problem as a function of 
the central obstruction, and for several mask sizes. Vertical lines indicate the geometry of 
existing telescopes. Apodizers throughput for large masks saturate for smaller apertures to 
a lower value of throughput. 
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Fig. 3. — Example of apodizer transmission for the geometry of Gemini/VLT. The mini- 
mum intensity transmission is 12% at the edges and throughput is high: 63%. A classsical 
Lyot coronagraph with undersized Lyot stop, has a typical throughput of 40-60% . The 
corresponding mask has a diameter of 4X/D. 
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Fig. 4. — Log scale broadband coronagraphic PSFs (AA/A = 20%) corresponding to existing 
telescopes geometries (AEOS, Gemini, VLT, Palomar, HST, CFHT). The mask sizes are 
optimized for broadband and have a typical diameter of 4.2X/D. The peak value of the PSF 
is normalized to the one withouth focal plane mask. The top set of curves corresponds to 
the un-occulted PSFs. These results are obtained without wavefront errors. 
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Table 1. 



Telescope 


Obstr. 


Apodizer 


mask 


PSF@5A/D 


AEOS 


11% 


55% 


4.60 


1.310" 


-6 


VLT/Gemini 


16% 


56 % 


4.61 


1.710" 


-6 


Subaru 


27% 


58% 


4.61 


8.010" 


-7 


HST 


33% 


60% 


4.51 


1.010" 


-6 


Palomar 


36% 


62% 


4.48 


1.010" 


-6 


CFHT 


40% 


65% 


4.48 


2.310" 


-6 



Note. - 



This table corresponds to the illustration of Fig. 4 



